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ABSTRACT . " .' ' . i ' r ";. 

This paper describes; and illustrates a decision 
thec=>ry model to analyze student Select ion^trategies in Chapter 1 ; 
programs. The relationship between ^he method and the practice of 
mor^l .evaluation activity is based on viewing just ice as a 
fundamental moral concern in distributing resources, on§ which is 
accomplished, in /part, through student placement decisions. The 
de eta si on theory is well suited to promote services f or the most 
disadvantaged if onavaccipts^thi premise that- academic advantage is 
best: measured by., standardized achievement tests and that schools in 
pove=rty neighborhoods;, require additional support to serve those 
'stuSents, The model, 'its rationale, application , and limitations are 
disc^russed; 
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The Research on .Evaluation Program is a Northwest Regional 
Educational Laboratory project of research, development , testing , 
and training designed to create new evaluation methodologies for 
use in education . This . document is one of a series of papers and 
reports produced by program staff § visiting scholars, adjunct 
scholars, and project oollaborators-^-all members *of a eoopermv 
network of colleagues working on the development of new . ' • ' 
methodologies, * , . 

How can we assess the justice and equity of selection procedures 
used to determine which disadvantaged students receive augmented 
educational services? This paper presents a decision theory 
model based on assigning values to various possible correct, and 
incorrect placement decisions as one method of determining the 
equity of placement decisions in selecting students for Chapter 1 
.programs* i The model, its rationale , application, and limitations 
are discussed here, .* «* 

\ 1 Nick L, Smith, Editor 
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INSURING EQUITY IN STUDENT SELECTION 

V 1,2 - " 

UNDE& CHAPTER 1 



When Cong Ease passed Chapter 1 of the Educational 
Consolidation and * I improvement Act (ECIA) of 1981, it signalled 
its continued commitment to the concept that students residing' in 
poor neighborhoods and demonstrating achievement deficiencies in 
basic skills were entitled to augmented educational services. 
Chapter 1 replaced Title I of the Elementary and Secondary 
Education Act CESEA) of 1965, and, although its regulatory 
structure is modified r Chapter 1 is essentially the same program 
that Title I was. It carries an annual appropriation or about 
i 3 billion dollars, roughly 20, percent of the total federal 
education budget. 

Federal policy , in the form of law and regulations, 
structures the. selection of schools and /students for Chapter 1 
programs. Chapter 1 (formerly Title I) Evaluation Technical 
Assistance Centers <TACs) have provided consultation and training 
'since 1976 on* evaluation procedures, including issues relating to 
the selection process. An external evaluation of Title I 
evaluation practice found notable improvement in student 



selection in the ten*-v/ear period from 1972 to 1982 (Ressner , 
Alkin,^oruch/ Linn & Miilraan, 1982) • Reisner et al- observed, 
considerable variability, .however, in the gua Mty Qf^ eTection 
data. This may be due to varying distributions of evaluation 
duties (.nXIooal sqhopl districts. Many Chapter 1 staff who fill 
e valuator roles in small and medium size districts do so only on 
a part- time basis . They lack the technical knowledge that •* 
trained professional evaluators often take for granted* To" these 
staff, designing a student selection strategy presents 
significant technical and moral issues. « 

It is often the technical issues which receive the most 
attention, _ These concern the choice of a valid and reliable 
selection instrument which has a sufficiently high correlation 
with some predetermined criterion measure of selection soundness, 
such as the pretest. However , the moral issues must not be 

.' * ■"■ . . ' • ' "-•••:.■■> 



overlooked and these revolve around justice and equity in J , 
"selection * Frcp this added perspective , the adequacy of 
Selection and placement strateg ies is decidedly not reducible 
soltely to the technical soundness of the instruments i one musj: 
also take account of the consensual or negotiated institutional 
values upon which the selection strategies are implicitly based. 
These institutional values can be operationally defined as the 
utilities jthat are assigned Xo the parlous possible correct and. 
incorrect .placement decisions* ■ . • 

■ * Justics may be situat,ionally defined as fairness and 
impartiality in the way resources are distributed /to those who r 
ed to them. Federal % budget reductions have heightened 



are entitl 



concern ft 



jr.. justice , since, f e#er students « can. be served with- 
fewer dollars . , This fpper add^e^ses the concepts of justice and? 
equity ^s/ they , fmpinge on studervb^ placement decisions in 
Chapter 1. It also' describes a methodology that local district, 
evaluators can use to model and appraise alternative student 
■ selection strategies , theret^v being responsive to concerns . 
regarding how , equitably Chapter 1 res^arces have been distributed 

/ ". >/; * App r cache s to 'pe termini ng Equ i ty 



Federal statute requires that tfie placement of students into 
Chapter 1 programs occur , through the application of an objective 
selection process. In practice 'this generally takes the form of 
a rank ordering produced through a district testing program, 
often *in combination with some form of 1 teacher judgment. 
Chapter 1 participants are selected by starting with the 
lowest-ranked student and continuing until all available program 
spaces have' be'en filled- Students requiring qther special ' 
services (e*g . , * special education) may be excluded - Typical * 
elements of the procedure that local ^district personnel must' 
decide are which test to use, whether or not to include teacher 
input, and, if so , what form that input will t^ke* 



8 



' > The standard mscjej^ for , evaluating Chapter 1 programs, the- 
riorro-nref "erfeflceB, tval taxation model,, requires that students be 
selected on the bails df a test administration other than, the one 
that wil^ be used to measure their pretest status; Usually 
dif f e^fent ^ists arp u se d fpr the two .purposes , The separafei^fi of 
selection .testing and pretesting allows the group's pretest 
percentile to be used as an estimate of the posttest status that 
would have resulted irr^. the absence of a Chapter 1 program 
(Tallmadge, Wood, & Gr^nnel , #1981) , The- separation Is a control 
that allows foe the ocrcurrenfce of regression to the mean, -which 
would otherwlii lta4 topees of the selected Chapter 1 group to be 
closer to the mean of the locai population on the pretest than 
they were .on the select -fcion test, /The pretest is viewed as a more 
precise indication of pre—program status, since it avoids /the 
problem T ofi a nonnorniat^ 4i str ikutien of error variance associated 
with the selection of -a esctreme-scorihg groiip v * 
The pretest ig 5£i&©times used as a check *or a criterion 
measure to estimate thi^e adequacy of the selection procedure, A, 
technical analysis of the selection problem typically focuses on 
the content validity fend reliability of the two measures, ^ and on 
the correlation between n them, If the pretest score is indeed 
taken as a criterion proper placement, the correlation between 

the selection measure and the* pretest can be interpreted as an 
indicator of predictive validity, The higher the predictive 
validity, the fetftr ^fc^adents there would be who outscore - 
nonselected students c**i the pretest, -should both groups take both 
tests, The objective :Ls to maximize predictive validity in the 
local context. - 
* / Under the nofln-rgf tranced evaluation, mode^, districts must 
r£qord their program p=»^r ticipants 1 pretest and posttest status in 
terms of national nojnn-^s , Let us assume that a district 
establishes seme natl^nai 3 percentile level on t,he pretest as an 
achievement standard s-^tting off those students in need of 



\ ■■ ■ 

supplementary Sffvic#s * If we further assume that Chapter 1; is 
predicated on an sntit dement principle of justice , * then 
nonselected students £ -filing below this standard, as well as 



selected students falling above it ,j create dissonance for loc^l 
Chapter 1 coordinators . The' burden of proof is frequently pi^£^$ 
on the -local school district when a noticeable proportion of 
students is found to &m *miselassif led in either of these too 

The application of a classical psychometric perspective is 
useful in identifying ^possible* sources' of inadequacy in a 
selection strategy # but it requires methods' of analysis " that ^(m 
not always Cfchniaally feasible and may be beyond tfie** expertise 
of small district project staff. When - used in practice the 
analysis probliiai frequently encountered due to missing data an3 
^restricted ability range in the- Chapter 1 population dan creati 
interpretation diff iculties. Moreover , the psychometric •", 



perspective eraphasiies underlying technical weaknesses without 
providing a direct basis for evaluating and improving a local 
strategy ptcm either a technical or moral standpoint s For thii 
reason an assessment of the selection process based on .decision; 
theory can be : of benefit to local personnel. 

Decision Theory " " - 

h decision theory perspective provides project staff With 
simple empirical methods* to evaluate alternative" selection 
s t r a teg ies as they may- be expe cte d to wo rk^ locally , . The X 
objective of a sounds selection strategy in decision theory terms 
is to minimize incorrect decisions, or, qonyersely, to maximize 
correct decisions i ".. ? 

Students are placeel into two groups^ on the basis of some # 
criterion, such as the pretest. Those below a prespecified 
pretest standard are classified as academically deficient, whilfe 
those, above this standard are classified as not academically 
deficient* The same population 6f students is dichotomized on 
the basis of the selection information. Some students^ are 

. 4 \ ■ ■ : v 

identified as io^aehievihg, and therefore qualif-ied fop 
Chapter 1 services, wri ile others are identified as not 
qualified. A single score, a composite score or a multistage 



gelee^sion 'process 'may .be used to support classifying students 

• quaUE led or not qualif ied * (Note that the term "qualified * lira, 
the p^^esent discussion refers to low rather; than high achieveme?— nt 
levei^s*} • =! . • > „ - - f 

"> . flaa.ving dichotomized independently on the two baSeiOfi , _ 

♦ selection information aftd the criterion, the eyaiuator ptepare*s=~ 



two two contingency tables with the selection tntatatiom oife» 

■ „ ■ " ' ' ". " ;= " * V ■ j 

one dE^miension and the criterion inf formation on tjie other (see 
f\gvLt^m 1} • The proportion of correct 'identifications (extract, , . 

tfeeiai ons) and the proportion of incorrect . t identifiOations, --- • 

(deoi^s ion errors) are readily derived from toe" tables, For thi~s 
analysis to be ooraplet:e# criterion scores must be present 1 for taha 
rnbnsel^_ected group. This will therefore rule outvus^ of the 
pretesst in those districts protesting only their- Chapter l " s 
studen^ts* • In those cases local evaluators wishing to employ 
decisi__on theory design ban; use a districtwide test for cciterio-**n 
information • * The selection of tee criterion will b6 discussed 
later in the, paper Vi , . ; . • 

Ite&o types- of dec is ion r or s are possible- l?irst f a stud^n 

identi fled as qualified on the basis of ^selection information nu^ay 

". t l . j 

be sub^sequently judged as academically^ proficient oh the. basis ■; of 

* ■ . ,? 1 • ■ * § • * '• ' ** *■ ' ■• * 

the iter ion information. These students are "mistakenly 1 * 

*piaoeeL_ in the Chapter 1 program* A second type \ off deeUion err&^r 

gecufs^- when a student classified as not qualifier is aubStquerit_ly 

deternfc-^xned . to* be academically deficient. These gtudenti are . 

"miStSL- keniy* excluded from the Chapter 1 program. Alternative 

selects- ion strategies can be compared on £he basis of the rate ± 

dec isL on errors . The following paragraphs define k a y concepts in 

the 3l>~:p roach . X" ' v - 

Thk^^ selection decision f typically based on a 'inefisuie'or**' 

measur es of achievement/ is a judgment to select or not Select —a ^ 

ptudert for the Chapter 1 program. The measures may consist of a 

single test score or a combination of measures iti whioh case . th»^ 

judg»e^3it may be bksed on a weighted composite or on, a iiquentia^^L* 

deci^i - on strategy. Students selected are those who fall below sa : 

j das ignSi ted cutoff score or , in the case of sequential decision 

: '•'•'•si- " 
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rules, are characterized by a pattern of scotii across multiple 
mepsuf es . Students not selected are those falling t above -the ° 
cutoff score * v ; .--- : . = ,\- ■ ' ';■ :■ t-''---'^ ■ 

^tedemioallY def icient students are those judged to be in ; 
need of tlte-vSkills^ taught -in the "Chapter. 1 program. Falling ^ V 
] below >m ghit^d standard of sk ill attainments on %t£e : vcr i te'jf ion 
measure serves as the operational definition of this 
classification. ,,. « 5 V- ' : -.. 

A correct identification results when a student selected for 
^fte Chapter 1, program , is also determined to be academically v V ' 
deficient (true positive) , or when, a student hot selected fqr the 
Chapter 1 program is also determined riot to be academically : 



deficient (true negative),. V f ; : : : >^v^;:;-V ;i 

• An incor rec t ident i f ication .res ults when a student selected 
for the Chapter 1 program Ais determined not to be academically 
deficient (false positive) , or when a student not selected for 
the Chapter 1 program is determined to be academically deficient 
(false negative) ..." ; 

Trie correct decision rate is the number of students correctly 
identified, divided by .the total number of students in the local 
population * The purpose of the analysis is to maximize this 
ratio > given a^ criterion; of satisf actory /achievement level *ahd 
alternative selection decisions* < 



Correct Decision Rate ng y+ j\q 



where and n^ are the numbers of students in "quadrants B 
and C f respective ly> and N is the total number of * students iV 
considered, in the -selection process , i . e . # n^+ng+n^+n^* 

/ the base rate is the proportion of students judged to* be 
academically deficient, based on the criterion measure. 

^ "■ '*■ .,, * Base Rite » yiq + hp " * 



with symbols being defined as above. 



The selection ratio is .the proportion of the student 
population -that 4s selected # or the number of available *ppsitions ^ 
in" thfe Chapter 1 program divided^ by the total number of students 
from which the selection is/ made, The selection ratio is * 
influenced ^ suorV factors as distyi^t poli)^> available J, ; 
resources # and the nature of tee instructional strategy . The 
selection ratio , therefore f jaay differ from the" base rate, as 
would be the case when resources do not allow all academically 
deficient students to be served. u" * 

. Selection Ratio = n A 4-*fiq . • 

with symBbls being defined as- above. . ■ ". . .* 

••• Uses of the Model -. : . . . 

The dec is ion theory perspective can be a useful addition to 
the psychometric approach for several reasons* Firsts consider 
the different foci of the methods. Psychometric approaches 
emphasize test characteristics while decision theory emphasizes 
the selection process itself* ~ 

An example is found in the Regression Model for selection 
decisioni (e*g., Cronbach & Gleser, 1965) ^illustrated in / 
Figure 2 » Th e selection measure and the criterion measure are . 
both considered to be on interval scales, and the least-squares 
regression equation is calculated to .determine a student 1 s 
predicted criterion performance on the basis of his or fier 
selection measure score . The regression line y 1 = a + Bx 
produces this predicted score for each possible selection score. 
In a bivariate regression the regression coefficient S is equal 
to the product-moment correlation between the variables* 

A cut-off score x* is chosen on the selection measure which 
determines entry into the Chapter 1 programs This score is 
generally the one which .sets off the number of students which the 
program can accommodate'. If we set aside for the moment 
exceptions arising from parental consent issues or policies 



s r..... 

regarding previoiis Chapter 1 participation, neither! of which 
affect the analysis/ we can state that all students failing below 
th is \ eut-oif • go into Chapter 1 1 all students faljing abo\£e %t 
^n^P-'^r^y^w";, ■ ' - : ^?/~\ v. ":"''■* "' -- ^ ;/. v ; : \J: 

V ;vX; To compar a this method with the <dne fa^sed on decision tteqr?> 
let ;us add the <frie line y - y* f where* y* is the cut-off oh th<i = • 1 
criterion measure, which identifies the achievement level < 
representing mii%iraum academic prof iciency. As Figure 2 - . ;_ ^ \ 1 
illustrates r_the two cut-off points divide the student population 
into the quadrants encounter ed* iij Figure; IV v= ' ^ * * '-'\ ; T- 

Judging the adequacy of the selection measure on j psychometric 
considerations entails several steps* First the evaltlator 



examines the reliabilities of the two measures and ascertains 
that they are both sufficiently high* The content validity of 
toe criterion test will indicate its adequacy in determining 
academic proficiency. The correlation between the two measures/ 
♦ represented; by the- regression coefficient B, is taken as an 
indicator of the criterion validity of the s^ection measure, 
(For the selection measure/ criterion validity rather than ; ; 
content validity is the critical psychometric feature/ since the 
test's express purpose is to duplicate the criterion 
information . Nevertheless 9 criterion validity and content 
validity will- be related, and in practice the latter fs" usually 
considered an important attribute,) -. 

• A selection procedure involves a series of dichotomous 
placement decisions on individual students. The greatest 
potential for selection error will occur * in the. area. around the 
intersection of the two lines formed by the cut-off scores. Yet 
the correlation coefficient is sensitive to all points in the 
bivariate distribution- If discrepancies in the rank order ings 
created by the, two measures exist anywhere on the ordinate scale** 
these win lower the coefficient B and decrease the apparent 
attractiveness of the ^selection measure. In a general sense this 
perception is correct, since, given a bivariate normal . * • . ' 

^distribution* discrepancies will occur in a predictable pattern 
: acrpss the range" of Adores. However , one must remember that in 
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&*i context of a selection process the correlation coefficient is 
an indirect indica tor * Minor discrepancies at:; the extr ernes of 
the ordinate scale will generally not have a bearing on the 

*aelebtio£t process, since in those eases the dichotomous selection 
decision will be * unaffected* Therefore one of the weaknesses of 
the psychometric analysis is that the statistical suimnary ifr 

. pEoVid^s directly bear on the information needed to ^; 

judge the selection process - In particular , to the extent that 
the variables d6 not follow a; bivar late normal distribution, the 
correlation coefficient is an inexact reflection of the ,-v.-., 
correctness of the selection decision. .This* is a special t 

_coj*ftMMSl^ 

in those cases one can expect greater deviation from normalcy in 
the distributions , with a correspondingly decreased predictive 
power to identify the tests' relationship |n the er it real ranges 
near U)e cut-off points- In sum, the purpose of a selection 
procedure is 6 - more directly reflected in the decision theory 
conceptualization t _ to maximi2e the number of correct . . 
classifications in student placement* 

Another advantage of Uie, decision theory perspective is that 
it accommodates non-interval-scaled classification oft the " 
selection measure . Most districts do not in fact use only test 
information in making selection decisions* Some; submit tentative 
selection lists basest on test rankings to students 'previous-year 
teachers fot confirmation or disconf irmatioh; as a result some 
students will be moved on to. the Chapter 1 list and others off of 
it. other multistage selection processes are sometimes employed 
as well. In addition/ some districts use composite scores fortoed 
by weighting and adding teacher ratings to test scores? it is' not 
clearly justified to assume interval scaling for' such meaures , \ 
U$i of the Regression Model is not recommended in those cases 
where the selection measure is not interval-scaled. The decision 
theory model, however, is appropriate in all cases; it require? 
simply Uie end results of i^e classification process. 



Utilities , The dee is ion theory approach is well suit ad to 
reflect* district values regatding 5 justice through the ^exibility 
inherent in the 'assignment of utilities • ' Distr lets can assign _ 
- these utility values ;tb thV.yariou§ eate 1 
. classification When computing summary values , the total in each 
cell would be multiplied by the cell * s utility value * * The ' €our . 
resulting numbers would be -summed and divided by N." * v ^ ••=■ 

The simplest coding scheme r and the one which we* have ?been . 
implicitly assuming thus, far # is to assign a value of +1 to 
coir eat classifications and a^ value of 0 to both categories of : L 
misclassif legion (false positive and false negative) . Summing, 
the utility-Hsoded totals across the four cells and dividing by N 
would then be^ equivalent to calculating the previously noted ! 
Correct decision Rate, 

The technique also allows for any other coding scheme deemed 
appropriate by. district eyalua tors* One alternative strategy is 
to value* th4. two misclassif icatipn t.ypes unequally * For _ : ^ 
instance, utility values might be set at 0 for false* positives 
and -1 for false negatives. From a justice standpoint r J a 
district might adopt this strategy if it decided that . withholding 
Chapter 1 services to an academically deficient child was a : . 
greater disservice than 'providing them to a child who is 
achieving satisfactorily . The strategy might also be desirable 
f rom a practical standpoint if fal^ 

rectify than false negatives ? for instance, it could be the case 
that children mistakenly placed in Chapter i would be identified 
within a f gw weeks and sent back to the regular classroom,. 
whereas children mis taVenly exc i ucied from Chapter 1 would have to 
be retested - or await program openings before entering the^ program. 

The choice of unequal utility values would not be 
particularly^ beneficial in comparing selection processes that - 
entailed equivalent selection ratios. This can be seen from a 
glance back at Figure 1. Let us assume that -for a particular 
^ear the base rate and the selection rate in a d'istrict are- 
fixed 9 though not . necessar ily equal , With the marg inal totals 
thus specified, determining any o£ the four cells will determine 

is ::; 



the whole matrix. The cells are not f^aa :i to ymzg and^tottls ?iny 



two selection strateg^s ^aii>he compared^ oh ^the basis of f ^h#r ^JV 
entry (e.g.,, numberxof correct, Chapter i classifications) rather 
v than a utility-coded summary $a lueddompu ted Lcr oss the four cells 
However , the unequal coding scheme >euld^be -helpful in f / 
comparing selection strategies with differing selection ratios » , 
an example, one district we have jworked with set out to modify 
tjktm selection process so as to admit fewer students to the f - v 
Chapter 1 program^ - Central bf f lc¥ st3f t^b^lieviiig that too many 
students who did: not need Chapter" I help ^ei^^ei|g referred; and 
accepted into the program/ plaimed pimply ^x^ower .the local 
cutoff score to decrease the number ^ 

Data from the previous year ' s evaluation were used to motfel, and 
evaluate alternative selection strateg ies * 'On reviewing t^e^fc_ . 
data, the district was compelled to take into account the effect ,: 
that reducing toe cutting score had on "increasing ^e ^m^^ of ^ 
students: erroneously; ^ 

negatives (erroneous exclusions) were judged more serious threats 
to equity than false positives ; ( erroneous admit tahces ) , ' 
utility-cpddng scheme reflecting toil value would cast doubt von 
the _new selection strategy to a greater extent than would a _ 
scheme assigning equal value to the .two forms of error . v 

' • \ '•• " Limitations of the Model - 



The decision theory model is presented as an aid to the 
assessment of equity in a district's Chapter 1, selection plan 
but it is not intended to replace the more usual psychometric > 
cons i der at ions * In particular , we must note two shortcomings of 
the modelr boto of which, concern the possibility of arbitrary 
judgment relating to the criterion measure, v \ 

• First is the choice of the criterion ^measure itself. The 
model would be misleading if it caused one to infer a lack of 
error in this diimension. In practice the criterion measure is 
subject to as much error as the selection .measure , as is evident 
f rem the case when both are standardized tests. To remedy this 



possible interpretive error , we suggest that the user view the 
model as an Index of agreerogntr, between two sources rather than an 
index of = the « sel ee t ion procedure Is matching ari^ib solute standard 
of •truth. 11 - r . \ v ^fe;> ■ ■■- ■! H 

We can understand the genes is of this problem if we consider 
that; the decision theory model is used n^st notably iri pejjsorinei 
dec is ioriraak ing (e.g. , Cronbach & Qjeser # t -196.5.) * In that field, 
" there is indeed an ultimate L st3ndard. against which the selection 
plan is judged, namely subsequent dtajployee performance. Thus 

measures of employee performance are concep tuall^, temporally, 

• ., ; -V . : : -: ' , •' " > . " ;v -\: • * - f* uV* - ^; ; ' ■" ■'" .•• ■ ; . :-'-V"--' 

and operationally distinct from measures used in se lection . The^ 

selection instrument is merely a more or less successful- > 

pred ictor of the or iter ion , v In education , however , the direct 

corollary^ of employee performance, later success in , the Chapter 1 

program, is not the variable t^at determines the correctness of 

the original Chapter 1 selection decision, lest the- student be 

blamed for prog r annnat i c shortcomings , , Federal ^tatute^ requires 

.that the admittance decision be based on level of academic 

proficiency; this classification, then , is the aim- of the 

cr iterion measure as much as it is the aim of the r select ion 

"• - ' : >J .'• • . . \ _ • - ; k • '_ '■' •• J • •-. ' ; - . 

measure, and in neither case is it made without some degree of . 

error . V* \>v 

Given that the criterion should be used to measure agreement 

with the sel ec tien meas ure , it can be any- accepted , objective - 

measure "of student performance. Probably the- most logical 

candidate is the test used for- pretesting, since substantively 

and temporally it is closely related to the .selection ' 

instrument* However, other measures could be used as well, 

including the previous spring's posttest, teacher ratings, or any 

other standard that district personnel fdel is suitable* As ft 

mentioned ear lier , in many districts it is hot possible to use # , 

the pretest as a criterion, because only the selected Chapter 1 J 

students* are given this test and therefore complete matrix ; 

information is lacking. 

The second shortcoming of the model lies in the dichotomy 

required for judging who is academically deficient* When a = 



district counts its program participants from the lowest-* 



achieving student on-i up, *the choice of a> cut-off score on the 
criterion measufrii ihay have little more sigh if idaheenthaiiv an 
af ter thought;. ^ ^Eraluatdfcs may find it difficult to dichotomise a 
variably that is fmpst » el early conceptualized, as contiguous. We . 
feel this is the 'greatest weakness of j the model* To overceae the 
possible arb itr ar iness of the cutoff j udgment , a district^^b^ild 
select a ioeaiij/ meaning^! standard r ; 3uehT as a percentile level \ m 
that has served a prey ioul-^Ieiimi ting fuhction r the percentile 
equivalent of ; W Q tar ge ted §rade equivalent score, or a specified 
number of- iniM - V 



.one lu s ion 



We have described and 1 illustrated, a method" that can be 'used 
to analyze student selection strategies in Chapter 1 prog;ajn^. : 
The xe lationship be^ge en method and the practice of mor ife^^ 
evaluation activity is b^sed on viewing justice as a fundamental 
moral concern iji distributing reiojMce^, one which ie , , ^ ; 
accomplished , in part f through student placement decisions. A 
general conception of justice requires us to, give consideration 
to fairness and impartiality. 

The decision theory- approach descr ibed does-^riot consider the 
consequences of placing student^ in Chapter £ programs The 
relative effectiveness of one program over another in terms of 
achievement gain is not consider etU - The local Chapter 1 program 
might be no more effective than the regular school program, ;qr it 
mightv even have a hindering effect on its participating 
students. 1 In principle", the iase of decision theory models coiild 
be expanded thr^ough the designation of achievement gain or 
treatment effect as the ordinal matrix variable, thus allowing 
the consequences of placement to be considered * Cronbach and 
Gleser (1965) provided th^ mathematical basis for these extended 
models years ago. However , * it migfit be more realistic to- assume 
that periodic program evaluations will detect neutral or harmful 
effects should they be -present* 



" . The decision theory analysis assumes that the '-objectives and 
; focus of the Chapter , 1 profram have been set prior. to analysis*- 
The grade levels, and subject arenas f or * the program must be . 
established prior to using' the decision itheory technique y While 
annual needs . assessments are required for Chap tefc I f undihg # - -\ ;. 
there is considerable variability in the soundness of those 
.assessments (Reisner et al* r 1982) . More .impor tant , thfere is 
* little reason to expect that making these decisions can be 
reduced to technical criteria (Gronbach and associates, 1980) , ^ 

. The deaision theory technique is well suited to promote* 
services for the most d isadvari taged if one accepts the' premise 
J thafc ?^ is 7 best measured by 'standardized 1L 

achievement tests and that" schools in poverty neighborhoods 
require additional support to serve those students. Thus/ the 
decision:" theory technique is compatible -with the intent; behind 
Chapter 1. . . " • •'. '•• „ *~ . ^/ i ^U- '■ - 
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FQ0TNOT1S 



h ver a ion off this paper ; was presented, *at the annual meeting 
of the Aiterican Educatla^nal Riseacih Association, Montreal, 

April, isaa. . > - ".:- ;r " ; - ; - 

A previous report- in this series contains ah earlier, less 
procedural discussion of this topic* >■ See S. L. Murray 
Utility and J^uity in, Student Placement,™ - BM^ Paper and 
Report Series No'- 56 , Northwest Regional Educational ;f y - 
Laboratory , Portland , Oregon, May, 1981. . - ; 
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